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WHAT IS CLAIMED IS: 

1 . A method of self-calibrating an omni-directional camera having a 
reflecting surface and a lens, comprising: 

capturing a sequence of omni-directional images; 
tracking a feature across the sequence of omni-directional images; 
defining an objective function as an error between an actual feature 
location and a predicted feature location; and 

optimizing the objective function to obtain a set of calibration 
parameters for the omni-directional camera. 

2. The method of claim 1 , wherein the feature is at least one of: (a) a 
point; (b) a line; (c) a plane. 

3. The method of claim 1 , wherein tracking a feature includes tracking 
point features within a pair of images contained in the sequence of omni-directional 
images. 

4. The method of claim 1 , further comprising identifying pairwise 
correspondence of tracked features. 

5. The method of claim 4, wherein defining the objective function includes 
finding a deviation from epipolar geometry for the identified pairwise tracked 

25 features. 

6. The method of claim 1 , wherein the objective function is defined based 
on characteristics of catadioptric imaging to relate tracked features to the set of 
calibration parameters. 
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7. The method of claim 1 , wherein the objective function includes an error 
metric and optimizing the objective function includes minimizing the error metric. 

8. The method of claim 7, wherein the error metric is an algebraic error 

5 metric. 

9. The method of claim 7, wherein the error metric is an image error 

metric. 

10 10. The method of claim 1 , wherein the set of calibration parameters 

includes at least one of: (a) principal point; (b) mirror shape parameter; (c) an 

aspect ratio; (d) an image skew. 

11. A computer-readable medium having computer-executable instructions 
1 5 for performing the steps recited in claim 1 . 

12. A method of self-calibrating a catadioptric camera system having 
mirrors and lenses, comprising: 

obtaining a sequence of omni-directional images of a scene from the 
20 catadioptric camera; 

tracking features within the scene across the sequence of omni- 
directional images; 

characterizing epipolar geometry based on an initial set of calibration 

parameters; 

25 defining an objective function as a deviation from the epipolar 

geometry for the tracked features; and 

minimizing the objective function to obtain calibration parameters. 

13. The method of claim 12, further comprising reformulating a projection 
30 equation to allow analyses to be applied in the same manner as for a rectilinear 

image sequence. 
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14. The method of claim 12, wherein the objective function includes an 
error metric that is defined in terms of the deviation of pairwise tracked feature 
correspondences from the epipolar geometry. 

15. The method of claim 14, wherein the error metric is at least one of: (a) 
an algebraic error metric; (b) an image-based error metric. 

16. The method of claim 15, wherein the image-based error metric defines 
an image distance to an epipolar curve. 

17. The method of claim 14, wherein minimizing the objective function 
further comprises using an optimization technique to minimize the error metric. 

18. A method for obtaining optimal calibration parameters to calibrate a 
catadioptric camera system, comprising: 

tracking features across an image sequence captured by the 
catadioptric camera system; 

identifying pairwise correspondence between the tracked features; 

defining an objective function in terms of an error metric based 
deviation from epipolar geometry for the pairwise tracked features; and 

minimizing the error metric to minimize the objective function and 
obtain the optimal calibration parameters. 

19. The method of claim 18, further comprising reformulating a projection 
equation to permit analysis subsequent to obtaining the optimal calibration 
parameters to be applied in the same manner as for a rectilinear image sequence. 
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